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aBSTRACT 

Presented are two sets of forms^^teacher level and 
national level^ — ^used by the National Center on Educational Media and 
Materials for the Handicapped to evaluate and select appropriate 
instructional materials. The documents provide check lists for 
evaluating materials on the basis of identification of needs (such as 
learner characteristics, program characteristics, teacher 
regairement s, and matching material to learner) , initial selection, 
review, and decision-isaking. (IM) 
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The National Center on Educational Media and 
Materials for the Handicapped (NCEMMH) in cooperation 
with the national system of learning resource centers, 
professional associations, various other public and 
private agencies, and interested individuals provides 
a comprehensive program of activities to facilitate 
the use of new educational technology in instructional 
programs for handicapped persons. NCEMMH provides 
leadership and service In the development, design, and 
dissemination of learning resources that are effective 
for the handicapped. 

The Center Is funded under Contract DEC- 300-72-4478 
by the Bureau of Education for the Handicapped^ U,S. 
Office of Education, Department of Health, Education, 
and Welfare. The contract Is administered through the 
College of Education and the Research Foundation of The 
Ohio State University. 

This document was prepared pursuant to a contract with 
the U.S. Office of Education, Department of Health, Ed- 
ucation, and Welfare* Bureau of Education for the 
Handicapped. Contractors undertaking such projects under 
government sponsorship are encouraged to express their 
judgment freely in professional and technical matters. 
Points of view or opinions do not, therefore, necessar- 
ily represent official Office of Education position or 
policy. 

Duplication of the criteria, as distributed by NCEMMH 
is permitted. 

For additional copies, please send a self-addressed 
envelope to: MMT, The National Center on Educational 
Media and Materials for the Handicapped, The Ohio State 
University, Columbus, Ohio 43210. 
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IDENTIFICATION OF NEEDS 

The outco/ne of stage I will be: a definition of the target learner and the 
learning environment prior to any selection of suitable instructional materials. 

A. Learner Characteristics 

(The following outline is intended to serve as a guideline to the selector 
of instructional materials in identifying the characteristics and education- 
al requirements of the specific learner for whom material Is being sought.) 

K Has an assessment of the learner occurred, and does the resulting dat 
speci fy : 

a, demographic informatiun about the learner. Including: 

No NA 

_ _ (1) age 

^_ : (2) sex 

(3) instructional/developmental level 

(4) language development or preference 

(5) Interest level 

limiting conditions (medical/physical factors, etc, ) 

c. behavioral/affective characteristics 

d. preferred modalities 

e. strength areas 
____ f. deficit areas 

2, Has an educational plan been developed, based on learner assessment 
data, which specifies: 

a. needed skill area 

. b* short and long-term instructional objectives 

- - , instructional strategies, including: 

(1) sequencing 

(2) reinforcement 

(3) modalities (input/output) 

(4) monitor^ing 

4 Pag© 1 
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Yes No NA 

d. reconmrendations for* 

(1) general instructional areas 

(2) specific materials 

_ (3) related activities 

B. Program Characteristics 

(The following outline is Intended to serve as a guideline to the selector 
of instructional raterlals In Identifying the overall program considerations 
with the specific learner(s) and learning requirements In mind,) 

1* Have provisions been made for integration of the Individual educational 
plan into the total instructional program: 

a. content 

_„ - b. curricular compatibility 

c. format/alternatives 

2* Would implemeiitatlon of the educational plan be affected by any of 
the following environmental constraints: 

a. tIme/cDSt/physlcal considerations 

b. grouping 

c* equipment 

d. personnel 
__ e, teacher skill 

11. INITIAL SELfCTION 

The outcome of stage II will be: the Identification of at least two pieces of in- 
structional material which, on first screening, appear compatible with learner 
requirements and which will be considered for further review. Identification of 
alternative materials for examination will facilitate final selection decisions on 
a comparative basis, 

A, S#areh 

(The items listed below outline the most corranon information resources available 
to the selector of instructional materials. The intent of this section is to 
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encourage the user to investigate various potential materials information 
sources. ) 

1. Have you located ricourses which might provide information about 
materials : 

a, colleagues 

_____ comnercial 



c, materials bibliographies 

d. journals 



_ e. curriculum libraries and centers (colleges, schools for handi- 
capped, learning resource centers) 

f . professional organl zations 

_ g. governmental agencies 

(national network, audio-visual center, etc) 

_ h. information systems (NIMIS, EPIE, ERIC, etc.) 

2. As a result of the above process, have you Identified at least two 
instructional materials which appear to address the learner's needs? 



Screen 



(Under optimal conditions, a written product abstract or review will provide 
information pertaining to all of the items listed below, so that actual In- 
spection of the product is not necessary. In the absence of thorough and 
accurate material descriptions, however, scrutiny of the material itself will 
be required. A secondary intent of this section 1s to educate both material 
users and material abstractors (including commercial publishers) about desir- 
able elements to be Included In product reviews,) 

U Does the material information resource provide Information about the 
identified Instructional product(s), such as: 

Yes No NA 



a. instructional level 



b, language level 

c, interest level 



d, sensory input and output modalities 
e* educational subject/skm content 
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f. format 

g. cost 

h. grouping requlrement(s) 

i. required equipment 

On the basis of the avanable information, does the identified in- 
structional material appear compatible with: 

a* learner characteristics 

(1) the learner assessment 

(2) the learner educational plan 
b. program characteristics 

(1) the total instructional program considerations 

(2) the identified environmental constraints 



The outcome of stage III will be: an in-depth analysis of an instructional material 
1n order to define the material's characteristics and match these characteristics to 
previously defined learner requirtments. Implementation of this stage necessitates 
actual examination of the instructional material. 



A. Analytis of Material 



(This section Includes recorTiTiended questions for determining the intrinsic 
qualities of the material (s) Independent of specific learner characteristics 
and program requirements J 

K Are objectives in behavioral terms (specifying what the student task 
is* under what conditions t and level of performance expected)? 

2, Are techniques of instruction for each lesson either clearly specified 
or self-evident? 

^ 3* Are facts, concepts^ and principles ordered in a logical manner (e,g*, 

chronologically* easy to difficult* etc/)? 

4, Does the material contain appropriate supplerentary or alternative 
activities that contribute to or extend proposed learning? 

, 5. Is repetition and review of content material systematic and appro- 
priately spaced? 



Yei No NA 



2. 
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Does the content appear accurate? 

Does the material avoid content which betrays prejudice, perpetuates 
stereotypes, or neglects the talents, contributions, or aspirations 
of any segment of the population? 

Can the material be readily adapted to meet individual learner 
differences in abilities and interests? 

Can pacing of the material be adapted to variations in learner rate 
of mastery? 

Is provision made for adapting^ altering, or combining input and re- 
sponse modalities according to learner variations? 

Does the material incorporate evaluation Items and procedures which are 
compatible with program objectives? 

Are there sufficient evaluative items to accurately assess student 
progress? 

Is performance assessed frequently enough to allow accurate assessment 
of student progress and continuous feedback to learner? 

Is the format uncluttered, grafmnatically correct, and free of typo- 
graphical errors? 

Are illustrations and photographs clear, attractive, and appropriate 
to content? 

Are auditory components of adequate clarity and amplification? 

Are all necessary components either provided with the material or 
readily and inexpensively available? 

Can consumable portions of material be easily and inexpensively re- 
placed or legally reproduced? 

Is cost reasonable In comparison with similar commercial materials 
or homemade alternatives? 

Does the publisher clearly state the rationale for selection of pro- 
gram elements, content, and methodolo^ (e.g., choice may be based 
on tradition, survey of other materials, logic of subject matter, 
experimental evidence, unvalidated theory)? 

Are testimonials, research, and publisher claims clearly differen- 
tiated? 

Are reinforcement procedures and schedules clearly indicated? 
Is a variety of cuing and prompting techniques used? 
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B* Matching Material to Learner 



(This section involves the Integration of the identified learner needs with 
the analyzed material characteristics to determine compatibility for instruc- 
tional purposas.) 



Yes No NA 



1* Are stated objectives and scope of the material compatible with 

learner's need? 

2. Are prerequisite student skills/abilities needed to work comfortably 
and successfully with the material specified and compatible with the 
learner's characteristics? 

3. Are the skills and abilities needed by the instructor to work effective 
ly with the material specified and compatible with instructor's ex- 
pertise? 

4. Are levels of interest, abstraction, vocabulary, and sentence structure 
compatible with characteristics of the learner? 

5. Is the degree of required teacher involvement (constant interaction, 
supportive or monitoring role, largely student directed, variable) 
compatible with teacher resources and learner characteristics? 

6. Does the material incorporate motivational devices to sustain student 
interest which are appropriate to the learner's characteristics? 

7. Are input and output modalities (visual, auditory, motor, tactile) 
compatible with learner characteristics? 

8. Is the demonstration of task mastery {e,g., written test, performance 
test, oral test) compatible with or adaptable to Intended learner's 
characteristics? 

9. Is the format of the material (e.g,, game, book, fllmstrip, etc.) 
compatible with the learner's mental and physical abilities? 

1 Q ^ Is the durability and safety of the material adequate for the learner? 

11^ is information provided indicating (successful) field testing of the 
material with students similar In learning characteristics and inter* 
ests to those of the loarner? 



V, DECISION MAKING 



The outcome of stage IV will be: a final determination of material suitability for 
use In a specific learning situation. Individualization of the decision making, 
based on Items of priority concern, is implicit In this process. 
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A. As a result of the review process, which questions have you identified as 
(most) critical to you in deciding to utilize the material with the learner? 

B. On the basis of those critical priority concerns , is the material appropriate 
for specified learning requirements? 

_ Yes (implies accept) 

No (implies reject) 

^_ Unsure (requires more analysis) 

C. If unsure of appropriateness, are there other less critical questions which 
could be considered 1n making the decision to utilize the material? 

D. On the basis of those additional considerations, is the material now deemed 
appropriate for specified learning requirements? 

Yes 



Unsure 



If still unsure of appropriateness of the material, will comparison with other 
previewed material (s), in relation to critical questions, help Identify the 
material which most closely approximates the specified learning requirements? 

F. If still unsure of the appropriateness of the material, would modifications 
of the material render it usable? 

1. Do you have access to resources for required modification? 

G. If no: 

1* Return to search process. Re-examine sources of material identification 
and information in locating other potential materials, 

2. Review learner characteristics In an effort to modify requirements for 
material . 
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STANDARD CRITERIA 

FOR THE 
SELECTION AND EVALUATION 

OF INSTRUCTIONAL MATERIAL 

National Level 



I. IDENTIFICATION OF NEEDS 
A. Sources 

II. INITIAL SELECTION 

A. Search 

B, Screen 

III. REVIEW 

A. Learner Characteristics 

B. Teacher Requirements 

C. Materials Characteristics 

D. Matching Material to Learner 

IV DECISIONS 

A. Use 

B. Adapt 

C. Field Test 

D. Recommendations 

V EVALUATION 
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Prepared by the AmC/SO/NCBMMH Program 
Dimtribut&d by NCBmm, The Ohio state Univmrsity , Colunibus, Ohio 43210 



The National Center on Educational Media and 
Materials for the Handicapped (NCEMMH) in cooperation 
with the national system of learning resource centers, 
professional associations, various other public and 
private agincies, and interested individuals provides 
a comprehensive program of activities to facilitate 
the use of new educational technology In instructional 
programs for handicapped persons. NCEMMH provides 
leadirship and service in the development, design, and 
dissemination of learning resources that are effective 
for the handicapped. 

The Center is funded under Contract OEC-300-72-4478 
by the Bureau of Education for the Handicapped, U.S* 
Office of Education, Department of Health/ Education, 
and Welfare. The contract Is administered through the 
College of Education and the Research Foundation of The 
Ohio State University. 

This document was prepared pursuant to a contract with 
the U.S, Office of Education, Department of Health, Ed- 
ucation^ and Wei fares Bureau of Education for the 
Handicapped. Contractors undertaking such projects under 
government sponsorship are encouraged to express their 
judgment freely in professional and technical matters. 
Points of view or opinions do not, therefore, necessar- 
ily represent official Office of Education position or 
policy. 

Duplication of the criteria, as distributed by NCEMMH, 
is permitted. 

For additional copies, please send a self-addressed 
envelope to: MMT, The National Center on Educational 
Media and Materials for the Handicapped, The Ohio State 
University, Columbus* Ohio 43210. 
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National Levml 
IDENTIFICATION OF NEEDS 



The outcome of stage I will be: identification of the availaDility and 
adequacy of sources of need Information prior to any selection of suitable 
instructional materials, 

A« Sources 

1* The National Needs Assessment sponsored by the Bureau of 

Education for the Handicapped 

2- Consumers who are currently working with handicapped children 

^_ . 3, Analysis of curriculums and instructional priorities at Learner 

Level 

4, Analysis of learner characteristics 

5* Availability of appropriate materials for curricular areas 

6. Availability of effective materials for learners 
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II INITIAL SELECTION 



The outcome of stage II will be: the Identification of at least ten pieces 
of Instructional material which, on first screenlngp appear compatible with 
learner requirements and which will be considered for further review* Iden- 
tification of alternate materials for examination will facilitate final 
selection decisions on a comparative basis* 

A. Search 

(The items listed below encourage the user to investigate various poten- 
tial materials infonnatlon sources and to consider essential points when 
gathering information about materialsO 

Yes No NA 



U Have you identified resources for materials which have potential 
use with the handicapped? 

2, Have materials been identified which may be appropriate for the 
learner characteristics of the handicapped? 

3. Have materials been identified which may be, appropriate for the 
currfcular needs of the handicapped? 



Ser##n 

(Under optimal conditions t a written product abstract or review will pro- 
vide Information pertaining to all of the items listed below, so that 
actual inspection of the product is not necessary. In the absence of thor- 
ough and accurate material descriptions^ however, scrutiny of the material 
itself win be required*) 

Yes No NA 



1- Is it a learner-use material? 



2* Is It an instructor-use material? 



3. Are all components of the material available? 

4. Does the material have potential for use with the handicapped? 

5. Is the material designed for use by the handicapped? 

6* Does the material appear to be practical to use with the 
handicapped? 

7, Does the material appear to be easily usable by the handicapped? 
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National Level 

8. Is the format of the material appropriate for the target 

handicapped audience? 

9* Is the material of acceptable technical quality? 

10. Does the material have instructional oblectives? 

11 • Does the material appear to meet the curricular needs of the 

handicapped target population? 

12. How does the cost of the material affect the accessibility to 

the material? 

13. Does the material appear to present any physical danger to the 

target handicapped audience? 

REVIEW 

The outcome of stage III will be: an In-depth analysis of an Instructional 
material In order to match (section D) the material for use with a specific 
student based on section A, Learner Characteristics^ section Bs Teacher 
Requirements, and section Materials Characteristics, Implementation of 
this stage necessitates actual examination of the instructional material. 

A. Learner CharaQteristies 

(The following outline is intended to serve as a guideline to the selec- 
tor of instructional materials in identifying the characteristics and 
educational requirements of the specific learner for whom material Is 
being sought.) 

1. What are the possible modes of Input? 

auditory 
visual 
tactile 
^ kinesthetic 

2. What are the preferred modes of input? 

auditory \' ' . ' / 
visual 
tactile 
kinesthetic 
multlsensory 
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3. What, are the possible modes of response? 
varbal 
__ written 
gesture 

^- What Is the learner's Initructional level? 

5. What is the learner's Interest level? 

5* What Is the learner's reading level? 

^- What Is the learner's Interest areas? 

L What are the learner's mte rest/motivation requirements? 



^* use of a garre-type format 

b* ^ ^ use of humor 

c. use of a variety of stimuli 

d. use of suspense 

^* use of novel ty 

of interaction system of Instantaneous feedback 
9* use of cartoon format 

h, use of puppets 

1* use of characters 

9* What are the learner's entry level skills? 

10- . What are the learner's reinforcement requirements? 



Teacher Requirements 

(The following outline Is Intended to sefve as a guideline to the selec- 
tor of Instructional materials in identifying the requirements to allow 
a teacher/Instructor to effectively use the material.) 

^' Are a teacher's manual and/or Instructions provided? 

2, If a teacher's manual and/or Instructions are provided, does It Includ 

3* philosophy and rationale 
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b. statenwnt of objectivas 

c. _„ statement of instructional and interest levels 

d. statement of reading level 

e* statement of prerequisite skins 

f* listing of materlal/pragram elemsnts 

g* listing of required materials and equipment 

h- suggestions for teacher/Instructor use 

1* suggestions for student/learner use 

j* suggestions for Instructional alternatives 

k- ^ suggestions for evaluation 

1* suggestions for additional resources 

Instructor time requirements* 

a. ^ training 

b* preparation 

c. ^ use 

d. ^ clean-up 

What is the degree of instructor InvolveTOnt? 

^* full-time teacher involvement is required during instructional 

period 

b. part-time teacher involvement required 

c. no teacher involveTOnt required 

d* full-^ time aide Involvement required 

e. part-time aidelnvol vement required 

f* no aidelnvol vement r^ njlred 

g. full-time parent Involvement required 

h, part-time parent involvement required 

1* no parent Involvement required 

j* full-tlTO peer involvement required 
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k. part-tlmt peer involvtment rtqulrid 

1* no peer involvement requirfd 

m. rnaterlals can be used Independently by learners 

5. Is the material practical? 
Yes No NA 



_ a, maneuvsrabillty 

_ _ b. ease of storage 

^ c, number of parts 

d. Identification of parts 

__ _____ e. size of parts 

f, storage/organization of parts 

g. durabnity of product and packaging 

h. replaceablllty of consumable and nonconsumable 

parts 

1. requires use of specialized equipment 

6, Is the total cost reasonable? 
Yes No NA , 

^ a. Inservlce training 

^ b. Initial cost 

c, par use cost (replacement of consumables) 

d, required supplementary materials costs 

^ a. raplacement cost (replacement of nonconsumables) 

7, ^ ^ Is tha material appropriate for the curriculum? 

8, ^ Has this material been field tested? 

0. ; - If so^ has It been found to be'effectlve? " 
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Materials Charactariatlcs 

(The fonowing outHni is Intended to serve as a guideline to the selector 
pf Instructional materials in Identifying specific characteristics a ma- 
terial requires to allow for communication with a learner*) 

K Technical quality 

a. Quality of auditory presentation: Acceptable Unacceptable 

(1) clarity (easily understood, 
recording quality good) 

(2) an^liflcation 

(3) voice level 

(4) dialect/accent 

(5) voice speed 

(6) voice quality 

(7) sequence 

(8) quality of narration (reader 

style) 

(9) music/sound/voice mixing 

b- Quality of visual presentation: Accaptable Unacceptable 

(1) sharpness 

(2) color ^ 

(3) distracting elements 

(4) complexity 

(5) size relationships 

(6) sequence 

(7) subjective angle (learner point 

of view) ' . - 

(8) objective angle (observer point 
of view) 

(9) composition (visual format* 
visual arrangement) 

(10) figure-ground definition 
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c. Qyatlty of print and graphic prisenta- Acceptable Unacceptable 
tion: 

(T) legibility (styli and size) 



(2) captioning (location and pacing) 

(3) clarity of print (contrast) 



(4) accuracy 



d. Quality of tactile presentation!: 

(1) braille (clear and easily 
discrlmlnable) 

(2) tactile drawings (clear and easily 
discrlmlnable) 



(3) texture (clear and easily 
discrlmlnable 



(4) composition (physical format* 
physical arrangement) 

(5) manipulables (discrlmlnable^ 
dimension* shapet mass) 



Instructional quality 
Yes No NA 



a) Does the selection of subject matter facts adequately 
represent the content ai*ea? 

b) Is the content presented in the material accurate? 

c) Is the content logically sequenced? 

d) Is the content organized for ease of study? 

e) Are various points of view* including treatn^nt of 
minorities j handicapped* Ideologfesp personal and 
social values, sex roleSs etc., objectively repre* 
sented? 

f) Are the objectives of the-raterial clearly st&ted? 

g) Is the content of the material consistent with the 
objectives? 

h) Are the prerequisite skills for use of the materials 
stated? 

1) Are essential sub-skills required included In the 
instructional sequence? 
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_ j) Is the reading level of the ntatenal stated? 

^) Is the vocabulary systefnatlcally Introduced? 

1) Is the vocabulary consistent with the stated 

reading level? 

m) Is the instructional level stated? 

^ ^ ri) Is the interest level stated? 

o) Is the material self-pacing? 



p) Does the material provide for frequent reinforcement 

of major concepts? 

q) Does the material summarize and review major points? 



^ , , __ r) Does the material provide frequent opportunities for 

active student involvement and response? 

_ ^ ^s) Does the material provide for evaluation of user 

performance? 

t) Does the material provide criterion-referenced 

assessment? 

u) Are all of the supplementary materials needed for 
instruction included in the materials package? 

Matohing Material to Laarner 

(The following questions require a synthesis of information gained from 
stage III^ Review. The synthesis is essential before proceeding to stage 
IVt Decision,) 

Yes No NA 

■ '> 

1- Are the characteristics of the material compatible 

with perceived learner characteristics? 

2* Are the characteristics of the material compatible 

with perceived teacher requirements? 

_ 3* Have you checked the 11st of criteria in the 

TEACHER LEVEL, stage III, Review, section Match- 
' ' ^ Ing Material to bearner? - * 
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IV, DiCISIONS 



The outcomt of stigt IV will bei i final detirmlnatlen ©f materfal iuitibflfty 
for uit In a sptcifle Itirning iltuation. Indlvf duilliatfon of the decision 
miking^ bastd on \t%m of priority concern. Is tiipllelt In this prociis. 

After tht rtvfiw preciss, it was found that tht naterial wasi 

Yes No Ni 

.^^^^^ ^ ntedid by the leaf ner 

usable with tht leamir 

- - ■ usable by the instryetof 

^ effective 



Oicliions to: 



a. Adapt 
C. Fi'tid Test 

can be madt by Identifying from the review data responslveniss of tht material 
to leamtr nted, uiibiflty with tht learner, usability by the Instruetor. and 
effeetlviness, 

DireatimBt For taeh crittrlon mtti plaet a in tht approprlatt box* 
For each criterion net met* plaet a in the appropriate box/ If no informa- 
tion is availabltp place an "NI*' In the appropriate boK- 



Needed 



Usable with 
_Le_arntr 



Usablt by 
Tiaehtp 



Efftctive 



J. 



Match your review iunmary with the decision matHji below i 
Dp ReDomifiendatlons 

Recocnmend for^ 



N 






E 


+ 


+ 


+ 


4 


+ 


■I- 






+ 


+ 


4- 


HI 


+ 


+ 




4 


+ 
























+ 




+ 


+ 






+ 


NI 








+ 






+ 


4 








'f- 
















NI 



U ^ Use/iMki aval libit for yii/informatlon 

disstmi nation 

A ^ Adapt 

U/FT ^ Use/Field Test 
R/A/D ^ Rijict/Adapt/Dtvtlop 
R/A/D ^ Rijtct/Adapt/Otvtlop 
^A/D ^ ReJfCt/Adapt/DiVtlop 
R/A/D ^ Reject/Adapt/Dtvtlop 
R/A/D = Rtject/Adapt/Devtlop 
R/A/D ^ ^jtct/Adapt/Develop 
R ^ Reject/not acceptable 
R ^ Reject /not acceptable 
R - Reject/not acceptablt 
R ^ Rejtet/not acctp^ble 
R ^ Rejtct/not acceptablt 



22 



National Laval 



iVALUATlON 



Thi outcome of stage V win be: a final judgment, either positive, negative, or 
incQncluslva, as to the usefulness and effectiveness of the material with the 
learntr In a given learning situation. 

No NA 

1* Does this material meet the requirements of the teacher? 

(see teacher requirement section in review instrument) 

2. Does this nHterial met the requirements of the learner? 

(see learner characteristics section In review instrument) 

- 3* toes this material lead to the attainment of the specified 

objectives? (see Instructional quality section In the 
review instrument) 

. 4p Does the technical quality of the material meet the require- 
ments of the learner? (see technical quality section in 
review instrument) 

^ 5. Do the instructional qualities of the material meet the re- 
quirements of the learner? (see Instructional quality section 
of review Instrument) 
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